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Audio encoding and decoding 



The present invention relates to encoding and decoding of broadband signals, 
in particular audio signals. 



5 When transmitting broadband signals, e.g. audio signals such as speech, 

compression or encoding techniques are used to reduce the bandwidth or bit rate of the 
signal. 

WO 01/69593 discloses a parametric encoding scheme, in particular a sinu- 
soidal encoder, in which an input audio signal is split into several (possibly overlapping) time 

10 segments or frames, typically of duration 20 ms each. Each segment is decomposed into 

transient, sinusoidal and random components. It is also possible to derive other components 
of the input audio signal such as harmonic complexes, although these are not relevant for the 
purposes of the present invention. 

In the encoder a sequential analysis is done. First, the transients are detected 

15 and synthesized. The synthesized transients are subtracted from the audio signal. On the 

residual signal, sinusoidal analysis is performed and the synthesized signal is subtracted from 
the residual signal, generating a second residual. This second residual can then be used as an 
input signal to other modules in the encoder, such as the noise module. In order to generate 
the second residual, a modified windowing at transient positions is used in the sinusoidal 

20 synthesis. 

Once the sinusoidal information for a segment is estimated, a tracking algo- 
rithm is initiated. This algorithm uses a cost function to link sinusoids in different segments 
with each other on a segment-to-segment basis to obtain so-called tracks. The tracking 
algorithm thus results in sinusoidal codes comprising sinusoidal tracks that start at a specific 
25 time, evolve for a certain duration of time over a plurality of time segments and then stop. 

In such sinusoidal encoding, it is usual to transmit frequency information for 
the tracks formed in the encoder. This can be done in a simple manner and with relatively 
low costs, since tracks only have slowly varying frequency. Frequency information can 
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therefore be transmitted efficiently by time differential encoding. In general, amplitude can 
also be encoded differentially over time. 

In a sinusoidal audio encoder, the audio signal is analysed and several com- 
ponents, in particular sinusoids, are identified and isolated. The sinusoids are synthesized by 
an overlap-add procedure. Typically, subsequent frames have a period of overlap of 50 %. If 
a transient is present in a frame, the period of overlap is reduced in order to avoid pre-echoes. 
This is referred to as modified windowing. Traditionally, this (small) overlap is equal for all 
sinusoids. For low frequencies, this can result in audible artefacts. 

In the SSC (Sinusoidal audio and Speech Coder) sinusoidal audio encoder [1], 
an input signal is decomposed into several parametric components. One of the components is 
the transient component A part of the audio signal is labelled as a transient, if an event 
occurs that is very localized in time. Music examples are attacks of castanets or high-hats. 

The transient model is described in detail in [1]. A summary will be given 
here. In the SSC encoder two types of transient are identified: a step transient and a Meixner 
transient - see [1] p 3. The transient estimation procedure consists of the following three 
steps: 

1. Estimation of transient position in time where the position of the transient in 
the audio signal is determined. Also the type of the transient (step or Meixner) is determined. 

2. Estimation of transient envelope: In case of a Meixner transient, the Meixner 
window is estimated, describing the time envelope of the transient. 

3 - Estimation of sinusoidal content where a number of sinusoids are estimated, 

using the estimated Meixner window, to describe the transient. The sinusoids are represented 
by a frequency, phase and amplitude. 

Step transients are characterized by a sudden change in signal power level, i.e. 
there is a fast attack but virtually no decay. A characteristic feature of a step transient is its 
position, i.e. the time of its occurrence, and as such the position in time does not describe a 
signal by itself, but it is used to control the way, in which the elements of the sinusoidal 
object are synthesised. Based on the position parameter the same or a similar procedure is 
applied both to step transients and to Meixner transients. 

Another type of components is the sinusoids. In sinusoidal modelling, the 
models are typically of the form: 

*,<o = £>*(o (i) 

k=\ 
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where Uk is the underlying sinusoidal or sinusoidal-like signals and n is the segment number. 
For example, Uk(t) can be defined by: 

u k (f) =^(0-cos(a)(0 -f +*(*)) ( 2 ) 
where A(f) , <o(t) and (j>(0 are the amplitude, frequency and phase of the sinusoid, hi order to 
reduce bit rate, these parameters are preferably kept constant within a segment, but as 
indicated they can be time variant. 

Consecutive segments s n overlap each other. Therefore, the segments are 
multiplied by a window function (e.g. a Hanning window). The windows are designed to be 
amplitude complementary, i.e. the sum of consecutive windows is 1 at all times, in particular 
in overlapping periods. This is illustrated in Figure 1. U denotes the update period of the 
sinusoidal parameters, and O denotes the period of overlap between the consecutive windows 
Wl and W2 and between the consecutive windows W2 and W3. A typical value of U is 
around 8 ms (or 360 samples with a sampling frequency of 44.1 kHz). 

In Figure 2 a transient is present in the segment, and the windowing is changed 
in order to reduce the effect of pre-echo. The transient position in indicated by T. The two 
windows Wlm and W2m have been modified in comparison to figure 1 . The dotted parts of 
the windows correspond to the unmodified windows Wl and W2 in figure 1 . The window 
Wlm comprising the transient position T is modified by "closing" the window at the transient 
position with a steeper trailing edge than for the unmodified windows in figure 1, and the 
duration of the modified window is correspondingly shortened. The following window is 
correspondingly modified by "opening" the window at the transient position with a steeper 
leading edge than for the unmodified windows in figure 1, and the duration of the modified 
window is correspondingly extended. Due to the steeper closing and opening edges of the 
windows the modified period of overlap Om between the consecutive modified windows 
Wlm and W2m is correspondingly shortened. 

In practice, this is done by reducing the period of overlap (e.g. to 10 samples) 
at the position of the transient. The non-overlapping parts of both windows are set to 1, i.e. 
the maximum value. This windowing for the sinusoidal synthesis is used in case of a step 
transient as well as Meixner transients, and both in the encoder and the decoder. 

Figure 3 illustrates this, where the signal contains a transient in the form of a 
step-like increase in its amplitude. The dashed vertical line marks the position of the 
transient. The top trace shows the waveform of synthesized sinusoids with an overlap of 360 
samples, and the bottom trace shows the waveform of synthesized sinusoids with a reduced 
overlap of 10 samples. The top trace clearly has a pre-echo, whereby the temporal structure is 
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lost, whereas in the bottom trace, the temporal structure is still intact due to the use of the 
modified windowing. This known modified windowing at transient positions provides a 
solution to avoid pre-echoes at transients. 

However, the above-described known method has certain drawbacks. In case 
of transients, the modified windowing for the synthesis of the sinusoids does preserve the 
temporal structure in transient regions, due to the reduced period of overlap. However, this 
can lead to audible artefacts for sinusoids with low frequencies. In Figure 4, two sinusoids 
with low frequencies, 100 Hz and 70 Hz, are shown synthesised with a small period of 
overlap. At the transient position, a large discontinuity between the two sinusoids is present. 
This abrupt change has a high-frequency content, which is perceived as a click. If the period 
of overlap is extended, the discontinuity in the waveform will disappear, but the temporal 
structure around transients will also be lost, giving rise to pre-echoes. The invention solves 
this problem. 

It has been observed that at higher frequencies a smaller period of overlap 
does not introduce audible artefacts in the waveform. This is due to the shorter period of the 
high frequency sinusoids. On the other hand, for sinusoids with low frequencies, a larger 
period of overlap is more tolerable than for sinusoids with high frequencies. In high 
frequency regions, the temporal structure is more important than for low frequency regions. 
Therefore, in accordance with the invention the size of the period of overlap around tran- 
sients is made frequency dependent. For low frequencies, the period of overlap is larger in 
order to prevent clicks. A smaller period of overlap is chosen for the higher frequencies. At 
low frequencies the temporal resolution of the human ear is less than at high frequencies. 
Therefore, larger period of overlap between windows are allowed from a perceptual point of 
view. 



The above object and features of the present invention will be more apparent 
from the following description of the preferred embodiments with reference to the drawings, 
wherein: 

Figure 1 shows a diagram illustrating an overlap-add procedure for 
synthesizing sinusoids using normal windowing, 

Figure 2 shows a diagram illustrating an overlap-add procedure for 
synthesizing sinusoids using modified windowing, 

Figure 3 shows traces of waveforms of synthesized sinusoids, 
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Figure 4 shows a trace of waveforms of two synthesized sinusoids with low 

frequencies. 

In the Figures, identical parts are provided with the same reference signs. 



The invention includes the above-described known method of modifying the 
period of overlap between windows of consecutive segments including a transient position, 
both in encoding and decoding. The method of the invention improves the known method by 
making the period of overlap between windows of consecutive segments dependent on the 
frequency of the sinusoid. In particular, the period of overlap is longer for low frequencies 
than for high frequencies. 

In theory, the size of the period of overlap around transients can be calculated 
directly from the frequency of the sinusoids. For example, the frequency dependent overlap 
period O(f), measured in number of samples in the overlap period, can be defined as a 
decreasing function of the frequency fin Hz, e.g. as follows: 

0(f)=round < fl -&-j^J j (3) 

where F s is the sampling frequency in Hz, e.g. 44.1 kHz, and a, b and c are constants that are 
experimentally determined to give good perceived sound quality, in particular avoiding pre- 
echoes at high frequencies and clicks at low frequencies. In a preferred embodiment, a = 100, 
b = 96 and c = 7, which results in a slowly varying period of overlap per frequency. Different 
functions can be defined. 

For every sinusoid, a new window has to be constructed in order to perform 
the overlap. This increases the computational complexity of the sinusoidal synthesis 
significantly at transient positions only. 

A simplification of the method described above is to use a few discrete values 
instead of a continuous variation. In the simplest embodiment of the invention, for sinusoids 
with a frequency below 400 Hz the period of overlap is set to 100 samples, whereas for 
sinusoids with a frequency higher than 400 Hz, a period of overlap of 10 samples can be 
used. Then only two types of windows are needed. Naturally, any suitable number of 
frequency intervals and corresponding overlap periods can be chosen. 
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[ 1 ] E.G.P. Schuijers, A.C. den Brinker and A. W J. Oomen. Parametric Coding for 

High-Qualify Audio. Preprint 5554, 1 12th AES Convention, Munich, 10-13 May 2002. 
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CLAIMS: 



1 . A method of synthesising a signal comprising sinusoids from encoded data, 
the encoded data comprising, for each of a plurality of consecutive time segments, one or 
more frequency values (f) representing sinusoids, and data identifying the time of occurrence 
of possible transients, the method comprising generating sinusoids with each of the one or 

5 more frequency values (f), and linking sinusoids across a plurality of consecutive segments, 
where segments with no transients are weighted with a normal window (Wl, W2, W3) 
having a normal leading edge and a normal trailing edge, and where consecutive segments 
have a normal period of overlap (O) of their trailing edges and leading edges, respectively, 
and where segments in which the time of occurrence of a transient is identified, are weighted 

10 with a first modified window (Wlm) having a modified trailing edge, and the following 

segment is weighted with a second modified window (W2m) having a modified leading edge, 
so that the modified trailing edge and the modified leading edge have a modified period of 
overlap (Om), which comprises the time of the occurrence of the transient, and which is 
shorter than the normal period of overlap (O), wherein the modified period of overlap (Om) 

1 5 depends on the frequency value (f). 

2. A method according to claim 1 , wherein the modified period of overlap (Om) 
decreases with increasing frequency value (f). 

20 3. A method according to claim 1 or 2, wherein the modified period of overlap 

(Om) depends on the frequency value (f) substantially as f 170 . 

4. A method according to claim 1 or 2, wherein two or more fixed values of the 
modified period of overlap (Om) are used for corresponding frequency intervals. 

25 

5. An audio decoder for synthesising a signal comprising sinusoids from encoded 
data, the encoded data comprising, for each of a plurality of consecutive time segments, one 
or more frequency values (f) representing sinusoids, and data identifying the time of 
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occurrence of possible transients, the audio decoder being adapted to use the method of any- 
one of claims 6-9. 

6. An audio encoder for encoding a signal adapted to use the method of any one 

of claims 1-4. 
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ABSTRACT: 



The method creates an audio stream comprising tracks of sinusoidal compo- 
nents linked across a plurality of sequential time segments. Segments in each track are 
weighted with a normal window (Wl, W2, W3), and consecutive segments have a normal 
period of overlap (O) of their trailing edges and leading edges. Segments in which a transient 
5 component is determined are weighted with a first modified window (Wlm) having a 
modified trailing edge, and the following segment in the track is weighted with a second 
modified window (W2m) having a modified leading edge, so that the modified trailing edge 
and the modified leading edge have a modified period of overlap (Om) that comprises the 
transient component and that is shorter than the normal period of overlap (O), and wherein 
10 the audio stream includes sinusoidal codes representing the frequency and the transient. 

According to the invention, the modified period of overlap (Om) depends on the frequency 
value (f). 



Fig. 2 
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Fig. 3 




Fig. 4 



